Autonomous Systems

CONTENTS Introduction ................................................................................................ 2 I. The Control and Predictability Gap in Autonomous Systems .................. 7 1. We Want Control, But the Best We Can Do is Approximate ......... 12 2. The Problem with Lack of Control and Unpredictability in FaultBase Regimes ......................................................................................... 13 II. Fault as Failure to Educate ................................................................... 16 1. Syntactic Failure ............................................................................ 17 2. Semantic Failure ............................................................................ 19 3. Testing Failure ............................................................................... 21 4. Warning Failure ............................................................................. 21 III. Possible Utility .................................................................................... 24 1. More Predictable Systems ............................................................ 25 2. More Accurate Expectations ......................................................... 27 3. A Way to Decide Who Pays ........................................................... 28 Future Work .............................................................................................. 29